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Foreword 


The  SEI  produced  this  technical  report  for  those  interested  in  both  CMMI  and  the  TSP  and  in 
how  these  two  technologies  might  be  used  together  to  accelerate  their  process  improvement 
efforts.  The  report  also  clarifies  some  common  misconceptions  about  how  these  two 
improvement  frameworks  support  each  other. 

TSP-CMMI  Synergies 

When  adopting  an  SEI  improvement  technology,  many  organizations  mistakenly  view  it  as  a 
stand-alone  effort.  However,  software  engineering  is  a  rich  and  varied  field  and,  as  demon¬ 
strated  by  many  other  fields  of  engineering  and  science,  there  are  often  important  synergistic 
benefits  between  seemingly  unrelated  technical  disciplines.  To  encourage  organizations  to 
capitalize  on  these  potential  synergies,  the  SEI  has  a  strategy  for  relating  its  improvement 
activities  and  for  showing  its  partners  and  affiliates  how  its  many  programs  can  be  used  to 
support  and  enhance  each  other.  This  technical  report  is  an  early  step  in  this  strategy.  It  has 
been  produced  through  the  joint  efforts  of  the  CMMI  and  TSP  project  teams. 

Mapping  the  TSP  to  CMMI 

This  report  is  similar  in  nature  to  an  earlier  SEI  technical  report  mapping  TSP  practices  to  the 
CMM  [Davis  02].  At  the  time  of  the  earlier  report,  the  CMMI  framework  was  well  advanced, 
and  the  SEI  had  committed  to  extending  the  earlier  CMM-TSP  mapping  to  cover  CMMI. 

This  is  the  CMMI-TSP  report. 

When  we  originally  developed  the  TSP,  we  built  on  the  CMM  model  and  established  the  per¬ 
sonal  and  team  practices  needed  to  implement  the  key  CMM  process  areas  that  were  directly 
pertinent  to  development  teams.  As  shown  in  the  earlier  technical  report,  this  included  a  high 
percentage  of  the  practices  at  all  process  maturity  levels,  with  a  heavy  focus  on  maturity  lev¬ 
els  3  and  4. 

However,  because  the  CMM  had  important  gaps,  we  had  to  identify  and  define  a  family  of 
practices  that  were  not  covered  by  the  CMM.  These  included,  for  example,  risk  management, 
integrated  teaming,  and  distributed  engineering.  With  the  improved  coverage  that  CMMI  pro¬ 
vides  in  these  areas,  the  close  relationship  of  the  TSP  and  CMMI  should  be  clearer  than  be¬ 
fore.  This  close  relationship  has  advantages  for  TSP  teams,  but  it  should  be  particularly  valu¬ 
able  to  organizations  that  use  the  TSP  to  accelerate  their  CMMI  improvement. 
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The  CMMI-TSP  Improvement  Strategy 

Some  people  have  the  mistaken  impression  that  TSP  should  not  be  introduced  until  organiza¬ 
tions  have  reached  CMMI  level  2  or  higher.  It  is  now  clear,  however,  that  TSP  can  help 
organizations  at  all  maturity  levels,  and  that  the  sooner  TSP  is  introduced,  the  better.  Adopt¬ 
ing  TSP  has  been  shown  to  greatly  accelerate  CMM  process  improvement.  For  example,  SEI 
studies  show  that  the  mean  time  required  for  organizations  to  improve  from  CMM  level  2  to 
CMM  level  3  is  22  months  and  that  the  mean  time  to  improve  from  level  3  to  level  4  is  28 
months.  However,  a  NAVAIR  study  showed  that  its  AV-8B  Joint  Systems  Support  Activity 
moved  from  level  2  to  level  4  in  only  16  months  instead  of  the  expected  50.1  They  attributed 
this  rapid  pace  of  improvement  to  the  organization’s  prior  introduction  of  the  TSP.  While 
studies  are  currently  underway,  there  are  not  yet  any  completed  studies  that  document  the 
acceleration  achievable  in  CMMI  process  improvement  through  using  the  TSP.  Based  on  the 
work  done  to  date,  however,  the  improvement  benefits  should  be  at  least  comparable  to  those 
of  CMM  acceleration  with  TSP. 

Furthermore,  the  move  from  level  3  to  level  4  has  been  recognized  as  the  most  difficult  of  all 
CMM-based  improvement  steps  and  it  probably  will  be  the  most  difficult  CMMI  improve¬ 
ment  step.  The  principal  reason  for  this  difficulty  may  be  that  the  process  definitions  that 
many  organizations  develop  for  level  3  must  be  reworked  to  include  process  measurement 
when  they  move  to  level  4.  Because  TSP  includes  the  extensive  use  of  measures,  its  use  both 
accelerates  the  level  3  process  definition  work  and  also  largely  eliminates  the  need  to  rewrite 
these  processes  when  moving  to  level  4.  The  move  from  level  3  to  level  4  then  needs  only  to 
address  the  two  level  4  process  areas. 

The  objective  of  this  report  is  to  help  process  professionals,  process  managers,  project  lead¬ 
ers,  and  organizational  management  to  establish  process  improvement  strategies  and  plans.  If 
you  are  not  now  using  TSP,  this  report  will  show  you  why  it  would  be  helpful  to  introduce  it 
in  parallel  with  your  CMMI  improvement  efforts.  However,  if  your  organization  is  already 
using  TSP  and  if  you  are  planning  a  CMMI  process  improvement  effort,  this  report  will  help 
you  to  decide  on  the  most  efficient  and  expeditious  way  to  proceed.  In  either  case,  we  suggest 
the  use  of  TSP  to  guide  the  project-centered  improvements  and  to  concentrate  the  CMMI 
improvement  effort  on  the  organization-wide  responsibilities  that  are  not  as  completely 
covered  by  TSP. 

The  rest  of  this  foreword  assumes  that  you  have  a  CMMI  improvement  effort  in  the  planning 
stages  or  underway  and  that  you  are  considering  TSP  introduction. 


NAVAIR  News  Release  ECL200301101,  “AV-8B  JSSATeam  Soars  to  Level  4.”  Naval  Air 
Systems  Command,  Naval  Air  Warfare  Center,  Weapons  Division,  China  Lake,  CA,  January  10, 
2003. 
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Typical  Questions  about  TSP  and  CMMI 

People  have  asked  many  questions  about  the  relationship  between  the  TSP  and  CMMI.  Some 
of  the  most  common  questions  are  the  following. 

I  have  been  told  that  TSP  should  not  be  introduced  until  an  organization  is  at  level  3  or 
above.  Is  that  correct? 

No.  As  mentioned  earlier,  the  TSP  is  helpful  to  organizations  at  every  CMMI  maturity  level. 
Experience  demonstrates  significant  benefits  from  TSP  introduction  before  or  concurrent 
with  the  move  to  CMMI  maturity  level  3. 

We  have  a  crash  program  underway  to  get  to  CMMI  level  3  as  fast  as  possible.  Should 
we  attempt  to  introduce  TSP  at  the  same  time? 

That  depends  on  your  objective.  TSP  introduction  will  improve  organizational  performance 
faster  than  anything  else  you  do.  If  your  objective  is  solely  to  reach  a  given  maturity  level 
rather  than  to  improve  performance,  you  may  wish  to  defer  TSP  introduction.  However,  by 
concentrating  exclusively  on  achieving  a  maturity  level  rather  than  focusing  on  performance 
improvement,  you  are  likely  to  get  disappointing  results.  A  maturity  level  focus  may  lead  to  a 
bureaucratic  process,  and  this  generally  delays  real  process  improvement  and  damages  a 
development  organization's  performance  rather  than  enhancing  it. 

We  are  moving  to  CMMI  level  2  and  replacing  our  entire  development  environment 
Senior  management  would  also  like  to  introduce  TSP  at  the  same  time.  Technical  man¬ 
agement  is  resisting.  Should  we  push  ahead  with  TSP  anyway? 

Probably  not.  While  some  level  of  change  is  normal  in  most  organizations,  there  is  a  point 
beyond  which  change  can  be  destructive.  At  that  point,  it  is  usually  wise  to  limit  the  pace  of 
change  to  something  that  people  can  tolerate.  Remember,  the  organization  must  continue  to 
operate  productively  during  the  change  process. 

We  have  been  at  CMM  level  1  for  10  years  and  have  been  unable  to  make  significant 
improvement  progress.  Would  TSP  help  us  with  CMMI  improvement? 

It  very  likely  would.  Generally,  the  reason  that  organizations  stay  stuck  at  level  1  is  that  their 
senior  management  is  unable  or  unwilling  to  provide  adequate  support  or  to  give  sufficient 
priority  to  the  change  activities.  Since  CMMI  improvement  generally  must  be  implemented 
in  parallel  by  most  parts  of  an  organization,  large,  entrenched,  or  highly  bureaucratic  groups 
are  often  extremely  difficult  to  change.  Because  a  TSP-based  improvement  effort  can  be 
focused  on  a  relatively  concentrated  area,  it  is  easier  for  management  to  provide  the  needed 
focus  on  process  improvement.  However,  you  still  must  have  senior  management  support,  or 
no  improvement  effort  is  likely  to  succeed. 

Is  TSP  introduction  always  successful  or  does  it  sometimes  fail? 
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IX 


The  TSP  is  not  magic.  When  TSP  introduction  efforts  have  failed,  it  has  been  for  the  same 
reasons  that  CMMI  improvement  efforts  fail:  the  management  team  does  not  understand  or 
agree  with  the  need  to  change.  At  any  maturity  level,  the  most  common  problems  are  the  lack 
of  management  support,  changes  in  senior  management,  or  business  failures  and  cutbacks. 
Generally,  when  the  senior  management  champions  stay  in  place,  both  TSP  and  CMMI 
improvement  efforts  succeed. 


Final  Considerations 

It  is  becoming  clear  that  by  using  TSP,  organizations  can  greatly  accelerate  their  CMMI 
process  improvement  work.  However,  several  additional  points  should  also  be  considered 
when  deciding  whether  and  how  to  combine  TSP  and  CMMI  improvement  efforts. 

First,  through  using  TSP,  engineers  and  engineering  teams  can  see  the  reasons  for  many  of 
the  high-maturity  CMMI  practices,  and  they  will  be  more  likely  to  cooperate  with  and 
support  a  CMMI-based  process  improvement  effort.  It  is  much  easier  to  get  the  support  of 
engineers  who  have  PSP  training  (part  of  TSP  introduction)  and  TSP  experience. 

Second,  since  the  objective  of  any  software  process  improvement  effort  is  to  enhance 
organizational  performance,  and  since  this  will  require  changes  in  engineering  behavior,  any 
improvement  effort  should  be  accompanied  by  steps  that  demonstrably  change  engineering 
behavior.  PSP  and  TSP  do  this. 

Third,  a  major  risk  for  any  improvement  effort  is  that  it  can  become  bureaucratic  and  can 
impose  added  demands  on  the  engineers  instead  of  helping  them.  If,  as  suggested  by  this 
strategy,  the  group  charged  with  process  improvement  work  treats  TSP  teams  as  its  custom¬ 
ers,  this  risk  will  be  greatly  reduced. 

Fourth,  even  if  all  of  the  above  points  were  not  enough,  TSP  can  substantially  improve  the 
performance  of  the  organization’s  software  groups,  even  in  some  groups  that  have  already 
achieved  CMMI  maturity  level  5  [Brady  04]  .2 

Finally,  while  introducing  TSP  can  greatly  facilitate  CMMI-based  process  improvement,  this 
will  only  be  true  if  it  is  properly  introduced  and  used.  For  example,  each  TSP  team  should 
capitalize  on  the  organization’s  existing  processes  and  should  work  closely  with  the  estab¬ 
lished  quality  assurance,  process,  configuration  management,  systems,  requirements,  and  test 
groups.  For  the  TSP  effort  to  succeed,  all  of  the  team  members  and  all  of  the  involved 
management  must  be  properly  trained,  the  TSP  activities  must  be  led  and  coached  by  an  SEI- 
authorized  TSP  coach,  and  the  coach  must  be  available  to  coach  and  support  the  team 
immediately  after  the  launch.  Guidance  on  TSP  training  and  introduction  can  be  found  in 
Winning  with  Software:  An  Executive  Strategy  [Humphrey  02]. 


x 


Schneider,  Kent.  Keynote,  3rd  Annual  CMMI  User’s  Group  and  Technology  Conference,  Denver, 
CO,  2003. 
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Abstract 


With  the  advent  of  CMMl®  (Capability  Maturity  Model®  Integration),  development  and 
maintenance  organizations  are  faced  with  many  issues  regarding  how  their  current  practices, 
or  new  practices  that  they  are  considering  adopting,  compare  to  the  new  model.  The  Team 
Software  ProcessSM  (TSPsm),  including  the  corequisite  Personal  Software  ProcessSM  (PSP™), 
defines  a  set  of  project  practices  that  has  a  growing  body  of  evidence  showing  highly  desir¬ 
able  process  performance  in  terms  of  delivered  product  quality,  schedule  performance,  and 
cost  performance.  TSP  also  has  a  history  of  favorable  coverage  with  respect  to  the  SW- 
CMM®  (Capability  Maturity  Model  for  Software),  a  major  precursor  to  CMMI,  as  well  as 
several  real-world  implementations  that  have  helped  organizations  to  achieve  high  maturity 
levels  in  a  relatively  short  period  of  time. 

This  report  provides  an  essential  element  to  facilitate  the  adoption  of  the  TSP  in  organizations 
using  CMMI,  namely,  a  mapping  of  ideal  TSP  practices  into  the  specific  and  generic  prac¬ 
tices  of  CMMI.  By  having  such  a  mapping  (also  known  as  a  gap  analysis),  those  involved 
with  process  improvement  and  appraisal  efforts  can  more  easily  determine  how  well  the 
organization  or  a  particular  project  is  implementing  the  TSP,  how  well  projects  using  TSP 
might  rate  with  respect  to  CMMI,  and  where  and  how  to  fill  any  gaps  in  CMMI  coverage. 
Organizations  already  following  an  improvement  plan  based  on  CMMI  may  also  determine 
how  TSP  adoption  might  help  them  to  achieve  broader,  deeper,  or  higher  maturity 
implementations  of  CMMI  goals  and  practices. 
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1  Introduction 


Capability  Maturity  Model®  Integration  (CMMI®)  is  a  reference  model  consisting  of  best 
practice  descriptions  for  a  broad  range  of  engineering  activities.  It  is  the  successor  model  to 
the  Capability  Maturity  Model®  for  Software  (SW-CMM),  the  Systems  Engineering 
Capability  Model  (SECM)  from  the  Electronics  Industries  Alliance,  and  the  Integrated 
Product  Development  Capability  Maturity  Model  (IPD-CMM)  [Chrissis  03].  As  a  descriptive 
model,  CMMI  is  well  suited  for  appraisal  efforts  seeking  to  determine  a  particular 
organization’s  capabilities  within  the  scope  of  software,  systems,  integrated  product 
engineering,  or  acquisition  and  for  guiding  the  broad  direction  of  process  improvement 
efforts  in  these  areas  of  expertise.  However,  it  is  not  unusual  for  organizations  to  struggle 
when  attempting  to  define  operational  practices  that  are  both  effective  in  terms  of  getting  the 
work  done  and  that  adequately  cover  areas  of  the  model  targeted  for  compliance. 

The  Team  Software  ProcessSM  (TSPsm)  is  a  set  of  defined  operational  processes  originally 
designed  to  implement  high-maturity  project-level  practices  of  the  SW-CMM.  There  is  a 
growing  body  of  evidence  showing  that  TSP  performs  well  in  addressing  key  common  goals 
of  both  SW-CMM  and  CMMI,  namely,  delivery  of  high-quality  software,  schedule  perform¬ 
ance,  and  cost  performance  [McAndrews  00,  Davis  03].  In  addition,  TSP  processes  have  been 
shown  on  paper  to  compare  well  to  SW-CMM  practices  [Davis  02]  and  also  have  been 
demonstrated  to  be  effective  in  helping  real  organizations  to  achieve  high  maturity  on  an 
accelerated  basis  [Hefley  02,  Pracchia  04,  Switzer  04].  With  the  advent  of  CMMI,  the  ques¬ 
tion  naturally  arises  as  to  how  well  the  TSP  compares  to  the  newer  model.  The  purpose  of 
this  report  is  to  answer  that  question,  and  to  do  so  in  a  way  that  enables  TSP  implementation 
to  be  closely  coupled  with  CMMI  improvement  efforts.  The  goal  is  that  TSP  implementation 
will  enhance  and  enable  the  achievement  of  higher  CMMI  maturity  levels  in  considerably 
less  time  than  is  commonly  reported  [SEI 04]. 

The  tables  presented  in  Section  6  constitute  the  core  of  the  report.  These  tables,  one  for  each 
process  area  (PA),  list  each  specific  practice  (SP)  of  CMMI-SE/SW/IPPD  v.1.1  [CMMI  02a, 
CMMI  02b],  along  with  references  to  particular  TSP  process  elements  and  practices.  For  each 
practice,  a  score  is  assigned,  as  explained  in  the  methodology  described  in  Section  2,  along 
with  any  relevant  notes.  The  PA  tables  are  grouped  by  process  category:  project  management, 
process  management,  engineering,  and  support.  At  the  end  of  each  process  category  group- 
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ing,  an  additional  table  is  provided  to  summarize  how  the  TSP  maps  into  the  generic  practices 
(GPs)  for  that  process  category. 

Sections  3  and  4  of  the  report  provide  graphical  summaries  of  the  observation  scores,  group¬ 
ing  the  PAs  first  by  process  categories  per  the  CMMI  continuous  representation  (Section  3), 
and  then  by  maturity  levels  per  the  CMMI  staged  representation  (Section  4).  The  TSP  process 
elements  referenced  in  the  mapping  tables  are  listed  and  briefly  described  in  Section  5. 
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2  Methodology 


When  determining  how  to  score  TSP  practices  with  respect  to  related  CMMI  practices,  the 
following  guidelines  were  used  to  develop  scoring  values. 

•  Avoid  the  use  of  SCAMPI  class  “A  ”  appraisal  terminology.  The  Standard  CMMI  Ap¬ 
praisal  Method  for  Process  Improvement  (SCAMPIsm)  “A”  rules  of  evidence  clearly  are 
not  met  by  a  paper  exercise  such  as  this,  and  the  authors  want  to  be  unequivocal  in 
declaring  that  this  mapping  is  not  a  guarantee  of  SCAMPI  compliance  when  appraisal 
time  comes.  Therefore,  instead  of  “Fully/Largely/Partially/Not  Implemented,”  the  authors 
opted  for  the  terminology  detailed  below.  It  is  the  proper  activity  of  the  engineering  proc¬ 
ess  group  (EPG)  and  the  appraisal  team  to  make  the  determinations  required  by  the 
SCAMPI  method.  Readers  of  the  earlier  TSP-CMM  mapping  [Davis  02]  will  recognize  a 
similarity  in  terminology  between  the  two  reports. 

•  Avoid  problems  encountered  in  the  earlier  TSP-CMM  mapping.  While  many  of  the  ambi¬ 
guities  and  overlaps  between  organizational  and  project  practices  that  were  inherent  in 
the  CMM  for  Software  v.1.1  have  been  resolved  in  CMMI,  of  necessity  a  few  still  re¬ 
main.  The  authors  of  this  report  have  attempted  to  avoid  labeling  clearly  good  things  in 
the  TSP  as  “Partial,”  when  in  fact  they  are  mature  project  practices  that  support  a  desir¬ 
able  organizational  activity.  Therefore,  a  rating  of  “S”  for  “Supports”  was  formulated  to 
describe  more  closely  how  TSP  relates  to  the  model  practice,  while  making  it  clear  that 
there  is  more  to  the  practice  than  what  the  TSP  implements.  “Fully  addresses”  was 
changed  to  “Directly  addresses”  to  avoid  the  problems  inherent  in  questions  of  whether 
all  of  the  subpractices  of  a  particular  practice  have  been  covered.  “Directly”  says  exactly 
what  is  meant,  without  implying  that  all  subpractices  are  necessarily  implemented. 


Table  1:  Scoring  Terminology  Used  in  the  Maps 


Score 

Value 

Description 

D 

Directly  addresses;  for  TSP  practices  that  meet  the  intent  of  the  CMMI  practice  without  any  significant 
reservations  (can  be  project  or  organizational  practices) 

■ 

Partially  addresses;  for  project-oriented  practices  that  TSP  addresses,  but  with  some  significant  weakness 
or  omission 

S 

Supports;  for  organizational  practices  that  TSP  is  not  intended  to  fulfill  completely,  but  which  TSP 
supports  by  providing  practices  that  either  feed  into  the  CMMI  organization-level  practice  (e.g.,  data  for 
a  measurement  repository)  or  that  create  a  demand  for  or  use  the  output  of  such  a  practice  (e.g.,  tailoring 
criteria) 

SM  SCAMPI  is  a  service  mark  of  Carnegie  Mellon  University. 
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Score 

Value 

Description 

N 

Not  addressed;  for  project-related  practices  that  TSP  could  and  possibly  should  address  but  doesn’t  (i.e., 
a “gap”) 

U 

Unrated;  for  organizational  practices  outside  the  scope  of  the  TSP  (e.g.,  GP  2.1  Establish  an 
organizational  policy) 

2.1  Assumptions  Behind  the  Observations 

The  following  assumptions  underlie  the  observations  detailed  in  Sections  6  through  9  of  this 
report. 

1.  The  organization  in  question  used  the  SEI-recommended  TSP  introduction  strategy  for 
training  personnel  and  launching  projects. 

2.  All  projects  in  the  organization  are  using  the  TSP  for  all  phases  of  a  “normal”  develop¬ 
ment  life  cycle  (i.e.,  requirements,  architecture,  implementation,  deployment,  and 
maintenance).  Specifically  excluded  are  things  such  as  business  planning,  business  case 
analysis,  and  the  like. 

There  is  no  assumption  of  a  particular  maturity  level  or  capability  level  in  any  of  the  observa¬ 
tions.  However,  the  interpretation  of  whether  a  particular  practice  is  rightly  a  project-level  or 
organization-level  practice  remains  open,  and  is  one  of  the  major  issues  with  which  an  EPG 
must  deal  on  an  ongoing  basis.  The  resolution  of  this  issue  is  also  likely  to  change  over  time 
as  the  organization  and  its  projects  work  with  the  TSP  process  assets  and  assimilate  them  into 
their  own  ways  of  doing  business. 

In  general,  a  lower  maturity  organization  will  leave  more  practices  to  the  projects,  but  months 
or  years  later,  many  of  the  same  practices  for  a  similar  project  in  the  same  organization  will 
be  performed  as  organization-level  activities  by  the  EPG  or  other  designated  group.  A  higher 
maturity  organization  with,  by  definition,  significant  experience  in  process  improvement  will 
naturally  recognize  many  practices  as  standard  organizational  activities,  and  TSP  teams  will 
treat  them  as  such  when  defining  their  working  processes. 

This  report  defaults  to  the  assumption  that  specific  practices  (SPs)  in  the  project  manage¬ 
ment,  engineering,  and  support  categories  are  project-level  activities,  with  exceptions  noted 
as  they  occur.  Specific  practices  within  the  process  management  category  default  to  the 
assumption  that  they  are  organization  level,  again  with  exceptions  as  noted.  All  SPs  are 
treated  individually,  however,  with  one  observation  block  per  SP  in  the  analysis. 

Generic  practices  (GPs)  are  institutionalization  activities,  though  not  necessarily  organiza¬ 
tion-level  activities.  This  report  treats  the  GPs  collectively  according  to  the  process  catego¬ 
ries,  with  each  GP  having  one  observation  block  across  all  the  of  the  process  areas  (PAs) 
within  its  category.  While  this  approach  may  be  of  lesser  value  in  determining  how  well  an 
idealized  TSP  implementation  rates  against  CMMI,  the  intent  of  the  report  here  is  to  empha¬ 
size  that  the  GPs  really  are  institutionalization  activities,  that  TSP  provides  many  hooks  for 
true  institutionalization,  but  that  the  decisions  of  whether,  and  how,  to  push  the 
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implementation  of  individual  generic  practices  down  to  the  team  rests  with  the  organization. 
Also,  these  decisions  should  probably  relate  across  the  PAs  within  a  category.  The  approach 
used  here  seems  to  make  these  points  adequately. 
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3  TSP  and  the  CMMI  Process  Categories 


3.1  Overall 

TSP  as  written  covers  a  large  footprint  of  specific  practices  across  CMMI,  as  shown  in  the 
charts  in  this  section  and  the  next.  The  charts  each  show  the  percentage  of  SPs  addressed,  and 
to  what  extent  they  are  addressed,  with  respect  to  different  groupings  of  either  the  staged  or 
continuous  representations  of  the  model. 

TSP  as  typically  implemented  incorporates  existing  practices  into  a  defined,  measured  proc¬ 
ess  framework.  The  exact  mix  of  existing  practices  and  TSP  practices  is  therefore  different, 
not  only  for  each  organization  that  implements  TSP,  but  also  very  often  for  each  project,  even 
within  the  same  organization.  In  order  for  the  information  in  this  report  to  be  useful,  it  should 
be  combined  with  detailed  knowledge  of  an  organization’s  existing  practices,  possibly  gained 
through  a  SCAMPI  appraisal  or  other  formal  method. 


Figure  1  shows  a  summary  of  TSP  coverage  of  specific  practices  summarized  by  process 
category.  For  detailed  observations  of  each  PA,  see  Sections  6  through  9. 
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Figure  1:  Summary  of  TSP  Project  Practice  Coverage  by  Process  Category 
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3.2  Process  Management 

The  process  management  PAs  deal  with  cross-project  activities  related  to  developing,  shar¬ 
ing,  and  adapting  processes.  Most  of  these  activities  are  necessarily  not  specific  to  the  work 
of  a  single  development  project,  the  domain  of  the  TSP.  However,  TSP  practices  support 
nearly  all  of  these  activities,  either  by  providing  data  and  process  assets  for  organizational 
use,  by  providing  explicit  process  steps  for  using  organizational  assets,  or  by  providing  de¬ 
tailed  implementations  of  a  group  of  practices  that  can  serve  as  an  organizational  exemplar. 
Depending  on  implementation  choices  made  by  the  organization’s  EPG,  many  of  these  prac¬ 
tices  could  be  rated  as  directly  addressed. 


Figure  2  shows  the  percentage  of  process  management  specific  practices  addressed  by  TSP 
for  each  PA.  For  detailed  observations  of  each  PA,  see  Section  7. 
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Figure  2:  TSP  Practice  Profile  by  Process  Management  PA 

3.3  Project  Management 

The  TSP  shows  remarkable  coverage  with  respect  to  most  of  the  process  areas  in  the  project 
management  category.  Much  of  the  strength  of  the  TSP  lies  in  the  multiple  assets  that  it 
brings  to  bear  in  planning  and  tracking  a  project  using  data  gathered  and  analyzed  by  the 
project  team  on  an  ongoing  basis.  While  there  is  relatively  weak  coverage  with  respect  to 
Supplier  Agreement  Management  (SAM)  and  Integrated  Supplier  Management  (ISM)  spe¬ 
cific  practices,  a  project  team  using  the  TSP  and  planning  to  acquire  significant  components 
of  its  delivered  product  from  other  groups  would  likely  include  such  acquisition  activities  in 
its  planning  and  engineering  processes  as  necessary. 
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Figure  3  shows  the  percentage  of  project  practices  addressed  by  TSP  for  each  PA  in  the  pro¬ 
ject  management  category.  For  detailed  observations  of  each  PA,  see  Section  6. 
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Figure  3:  TSP  Practice  Profile  by  Project  Management  PA 

3.4  Engineering 

When  a  TSP  team  plans  its  engineering  activities,  it  begins  at  a  minimum  with  the  core  of 
TSP  development  and  maintenance  life-cycle  process  assets  on  which  to  draw.  More  often, 
however,  the  project  team  has  its  own  practices,  either  from  prior  development  cycles  or  from 
organizational  process  assets,  to  adapt  into  the  defined,  measured,  and  managed  framework 
learned  in  PSP  training  and  instantiated  during  the  TSP  launch.  While  the  chart  below  reflects 
strong  CMMI  coverage  using  the  TSP  default  development  processes,  the  process  group  us¬ 
ing  this  report  to  guide  a  process  improvement  effort  should  take  special  care  to  discover  the 
actual  engineering  processes  used. 

Figure  4  shows  the  percentage  of  specific  practices  addressed  by  TSP  for  each  PA  in  the  engi¬ 
neering  category.  For  detailed  observations  on  each  PA,  see  Section  8. 
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Figure  4:  TSP  Practice  Profile  by  Engineering  PA 

3.5  Support 

The  CMMI  support  categories  can  be  applied  to  any  process  area  or  process  category,  and 
therefore  lack  the  central  theme  that  the  other  categories  possess.  There  is  no  particular  pat¬ 
tern,  therefore,  in  how  the  TSP  addresses  these  categories.  For  example.  Measurement  and 
Analysis  (MA)  shows  strong  coverage,  reflecting  the  TSP’s  fundamental  alignment  with  such 
activities.  On  the  other  hand,  Organizational  Environment  for  Integration  (OEI)  deals  with 
activities  outside  the  scope  of  the  typical  TSP  team,  and  therefore  reflects  weak  coverage  by 
the  TSP. 

Figure  5  shows  the  percentage  of  project  practices  addressed  by  TSP  for  each  PA  of  the  sup¬ 
port  category.  For  detailed  observations  on  each  PA,  see  Section  6. 
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Figure  5:  TSP  Practice  Profile  by  Support  PA 
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4  TSP  and  the  CMMI  Maturity  Levels 


4.1  TSP  and  Maturity  Level  2 

At  maturity  level  2,  the  projects  in  an  organization  have  ensured  that  requirements  are  being 
managed;  processes  are  planned,  performed,  measured,  and  controlled  to  ensure  meeting  pro¬ 
ject  commitments;  suppliers  are  selected  and  managed  to  meet  project  commitments.  This 
means  that  commitments  are  established  and  reviewed  with  stakeholders,  management  has 
visibility  into  the  status  of  work  products  and  the  delivery  of  services,  work  products  are 
appropriately  controlled,  and  these  deliverables  satisfy  their  specified  process  descriptions, 
standards,  and  procedures. 

The  TSP  provides  specific  guidance  for  Project  Planning  (PP),  Project  Monitoring  and 
Control  (PMC),  Requirements  Management  (REQM),  Measurement  and  Analysis  (MA),  and 
Process  and  Product  Quality  Assurance  (PPQA).  While  Supplier  Agreement  Management 
(SAM)  is  not  specifically  addressed  by  TSP,  the  project  planning,  monitoring,  and  measure¬ 
ment  aspects  of  TSP  provide  support  for  these  activities.  It  is  not  unusual  for  an  organization 
using  the  TSP  to  start  asking  their  suppliers  for  TSP-equivalent  project  planning,  tracking, 
and  quality  information. 

Figure  6  shows  the  percentage  of  specific  practices  addressed  by  TSP  for  each  PA  at  maturity 
level  2.  For  detailed  observations  on  each  PA,  see  Sections  6,  8,  and  9. 
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Figure  6:  TSP  Practice  Profile  by  Maturity  Level  2  PA 

4.2  TSP  and  Maturity  Level  3 

At  maturity  level  2,  it  is  not  unusual  for  each  individual  project  within  an  organization  to 
have  a  different  set  of  management  and  technical  process  descriptions,  procedures,  and  stan¬ 
dards.  As  an  organization  moves  towards  maturity  level  3,  a  critical  distinction  becomes  evi¬ 
dent.  At  maturity  level  3,  the  standards,  process  descriptions,  and  procedures  for  a  project  are 
tailored  from  the  organization’s  set  of  standard  processes  to  suit  the  needs  of  each  project.  As 
a  result,  the  processes  that  are  performed  across  the  organization  are  consistent,  except  for  the 
differences  allowed  by  the  tailoring  guidelines. 

The  TSP  focus  is  on  teams,  not  organizations.  Even  if  all  projects  in  an  organization  are  using 
the  TSP,  there  is  a  need  for  additional  organizational  support.  (Look  at  Organizational  Proc¬ 
ess  Definition  (OPD)  for  examples  of  the  additional  support  required.)  The  TSP  provides 
teams  with  a  robust  set  of  processes  and  procedures  that  are  usually  tailored  to  meet  the 
team’s  needs  with  guidance  from  a  TSP  coach.  These  standard  TSP  processes  can  be  used  to 
support  the  creation  of  an  organization’s  standard  set  of  processes,  but  they  do  not  fully 
address  all  organizational  process  needs.  TSP  teams  also  collect  and  analyze  product  and 
process  data,  but  in  order  to  meet  the  intent  of  this  PA,  there  is  an  additional  need  for  an 
organizational  function  that  collects  and  reviews  this  data  and  makes  it  available  across  the 
organization.  In  fact,  it  is  not  uncommon  for  an  organization  using  the  TSP  for  product  devel¬ 
opment  to  initiate  TSP  process  development  projects  to  address  the  “organizational  PAs”  of 
maturity  level  3:  Organizational  Process  Focus  (OPF),  Organizational  Process  Definition 
(OPD),  and  Organizational  Training  (OT). 
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The  TSP,  along  with  the  PSP,  provides  specific  guidance  for  Requirements  Development 
(RD),  Technical  Solution  (TS),  Product  Integration  (PI),  Verification  (VER),  Validation 
(VAL),  Risk  Management  (RSKM),  and  Integrated  Teaming  (IT).  The  TSP  launch  process, 
process  and  product  data,  and  weekly  team  meetings  support  and  enable  Integrated  Project 
Management  (IPM),  RSKM,  and  Decision  Analysis  and  Resolution  (DAR).  While  Integrated 
Supplier  Management  (ISM)  is  not  specifically  addressed  by  TSP,  the  project  planning,  moni¬ 
toring,  and  measurement  aspects  of  TSP  provide  support  for  its  activities.  The  OPF  and  OPD 
process  areas  are  supported  by  the  process  elements,  process  architecture,  and  process  and 
product  data  from  the  TSP.  OT  is  enabled  and  must  be  partially  implemented  by  the  introduc¬ 
tion  of  TSP,  as  portions  of  the  organizational  training  needs  are  identified,  planned,  and  exe¬ 
cuted.  The  TSP  launch  and  status  reporting  processes  support  Integrated  Project  Management 
for  Integrated  Product  and  Process  Development  (PM  for  PPD,  often  shortened  to  1PM- 
PPD)  and  for  Organizational  Environment  for  Integration  (OEI). 


Figure  7  shows  the  percentage  of  specific  practices  addressed  by  TSP  for  each  PA  of  maturity 
level  3.  For  detailed  observations  on  each  PA,  see  Sections  6  through  9. 


TSP  and  CMMI  ML3 
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Figure  7:  TSP  Practices  Profile  by  Maturity  Level  3  PA 

4.3  TSP  and  Maturity  Level  4 

At  maturity  level  4,  the  organization  and  projects  establish  quantitative  objectives  for  quality 
and  process  performance  and  then  use  these  criteria  in  managing  the  projects.  Quality  and 
process  performance  are  understood  in  statistical  terms  and  are  managed  throughout  the  life 
of  the  processes. 

Organizational  Process  Performance  (OPP)  derives  quantitative  objectives  for  quality  and 
process  performance  from  the  organization’s  business  objectives.  TSP  launch  preparation 
calls  for  the  team  to  have  available  the  organization’s  standard  processes  for  use  by  the  team. 
A  typical  management  goal,  communicated  in  the  launch,  is  to  meet  certain  specified  process 
performance  and  quality  standards. 
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Quantitative  Project  Management  (QPM)  applies  quantitative  and  statistical  techniques  to  the 
management  of  process  performance  and  product  quality.  Quality  and  process  performance 
objectives  for  the  project  are  based  on  those  established  by  the  organization.  The  TSP  pro¬ 
vides  strong  support  for  this  process  area:  quality  and  process  performance  are  planned, 
tracked,  managed,  and  understood. 


Figure  8  shows  the  percentage  of  specific  practices  addressed  by  TSP  for  each  PA  of  maturity 
level  4.  For  detailed  observations  on  each  PA,  see  Sections  6  and  7. 


TSP  and  CMMI  ML4 
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Figure  8:  TSP  Practice  Profile  by  Maturity  Level  4  PA 

4.4  TSP  and  Maturity  Level  5 

At  maturity  level  5,  processes  are  continually  improved  through  both  incremental  and 
innovative  technological  improvements  that  are  based  on  the  quantitative  understanding 
achieved  at  maturity  level  4.  Organizational  Innovation  and  Deployment  (OID)  enables  the 
selection  and  deployment  of  improvements  that  can  enhance  the  organization’s  ability  to 
meet  its  quality  and  process  performance  objectives.  Causal  Analysis  and  Resolution  (CAR) 
provides  a  mechanism  for  projects  to  evaluate  their  processes  and  to  look  for  improvements 
that  can  be  implemented. 

The  TSP  explicitly  addresses  the  practices  within  the  Causal  Analysis  and  Resolution  (CAR) 
PA  and  strongly  supports  the  implementation  of  the  OID  practices.  Postmortem  meetings 
consolidate  and  begin  to  analyze  data  gathered  either  during  a  launch  or  following  a  develop¬ 
ment  cycle.  Specific  problems  and  suggestions  are  documented  by  process  improvement  pro¬ 
posals  (PIPs)  during  the  postmortem  or  at  any  time  in  the  life  cycle.  Future  launches  and 
relaunches  then  typically  make  relevant  adjustments  to  the  project’s  defined  processes.  Most 
organizations  implementing  the  TSP  recognize  the  value  of  such  feedback  from  the  primary 
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users  of  the  organizational  processes  and  create  mechanisms  to  incorporate  the  lessons 
learned  so  that  other  project  teams  may  benefit. 


Figure  9  shows  the  percentage  of  specific  practices  addressed  by  TSP  for  each  PA  of  maturity 
level  5.  For  detailed  observations  on  each  PA,  see  Sections  7  and  9. 


Figure  9:  TSP  Practice  Profile  by  Maturity  Level  5  PA 
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5  TSP  Process  Elements 


The  TSP  is  defined  by  a  set  of  process  elements  that  includes  the  following: 

•  scripts  to  guide  specific  work  processes 

•  forms  to  capture  specific  information  generated  by  enacting  one  or  more  scripts  or  other¬ 
wise  required  by  some  part  of  the  process 

•  role  specifications  to  guide  individuals  on  a  project  in  performing  critical  but  often  non- 
scripted  (possibly  non-scriptable)  activities 

•  other  assets  such  as  the  TSP  introduction  strategy,  checklists,  guidelines,  and  specifica¬ 
tions  not  related  to  roles 

•  training  courses  and  authorization  activities  in  the  TSP  and  PSP  technologies 

These  assets,  summarized  in  the  table  below,  are  referenced  in  the  ‘TSP  Reference”  column 

in  the  mapping  tables  of  Section  6. 


5.1  Scripts 


Grouping  /  Name 

Description 

Notes 

Launch  scripts 

LAU 

Team  launch:  to  guide  teams  in  launching  a  software¬ 
intensive  project 

LAU1 

Launch  meeting  1  -  launch  overview  and  kick-off 

Step  1  in  script  LAU 

LAU2 

Launch  meeting  2  -  roles  and  goals 

Step  2  in  script  LAU 

LAU3 

Launch  meeting  3  -  strategy,  process,  support 

Step  3  in  script  LAU 

LAU4 

Launch  meeting  4  -  overall  team  plan 

Step  4  in  script  LAU 

LAU5 

Launch  meeting  5  -  quality  plan 

Step  5  in  script  LAU 

LAU6 

Launch  meeting  6  -  detailed  next-phase  plans 

Step  6  in  script  LAU 

LAU7 

Launch  meeting  7  -  risk  assessment 

Step  7  in  script  LAU 

LAU8 

Launch  meeting  8  -  management  meeting  preparation 

Step  8  in  script  LAU 

LAU9 

Launch  meeting  9  -  wrap-up  management  meeting 

Step  9  in  script  LAU 

LAUPM 

Launch  postmortem  meeting  -  postmortem  on  the  launch 

Step  PM  in  script  LAU 

REL 

Team  relaunch 

REL1 

Relaunch  meeting  1  -  status  and  management  update 

Development  scripts 

DEV 

Overall  new  development  and  enhancement  process 

MAINT 

Overall  maintenance  and  enhancement  process 

ANA 

Impact  analysis  process 

CMU/SEI-2004-TR-01 4 
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5.2  Forms 


Grouping  /  Name 


Launch  forms 


GOAL 


ROLEMX 


SCHED 


STRAT 


SUMDI 


SUMDR 


SUMP 


SUMQ 


SUMT 


SUMTASK 


TASK 


Development  forms 


DEFECT 


TESTLOG 


.Description 


Asterisked  (*)  items  or  equivalents  are  implemented  in  the 
TSP  workbook  (see  Section  5.4) 


*  Team  goals 


Process  inventory 


*  Issue/risk  tracking  log 


Meeting  report  form 


Process  improvement  proposal 


*  Team  role  assignment 


Role  assignment  matrix 


*  Schedule  planning  template 


Strategic  planning  form 


*  Defects  injected  summary 


*  Defects  removed  summary 


*  Plan  summary  form 


*  Quality  summary  form 


*  Program  size  summary 


*  Development  time  summary  form 


*  Task  plan  summary 


*  Task  planning  template 


Defect  reporting  form 


Inspection  report 


Test  log 


Grouping  /  Name 


Role  manager 
specifications 


Customer  interface 
manager 


Design  manager 


Implementation 

manager 


Test  manager 


Planning  manager 


Process  manager 


Quality  manager 


Support  manager 


Other  role 
specifications 


Meeting  roles 


Inspection  roles 


Team  leader 


Team  member 


Description 


The  default  set  of  roles  to  be  assumed  by  members  of  the 
team:  customer  interface  manager,  design  manager, 
implementation  manager,  test  manager,  planning  manager, 
process  manager,  quality  manager,  and  support  manager 


Customer  interface  manager  responsibilities:  customer  focus, 
define  requirements,  manage  requirement  changes,  establish 
and  manage  requirement  standards,  and  reporting 


Design  manager  responsibilities:  lead  the  design,  manage 
design  changes,  establish  and  manage  design  standards,  and 
reporting 


Implementation  responsibilities:  lead  the  implementation, 
manage  implementation  changes,  establish  and  manage  the 
implementation  standards,  and  reporting 


Test  manager  responsibilities:  test  planning,  test  support,  test 
analysis,  and  reporting 


Planning  manager  responsibilities:  lead  team  planning,  track 
team  progress,  and  reporting 


Process  manager  responsibilities:  process  support,  tracking, 
analysis,  process  problems  and  process  improvement 
proposal  handling  and  reporting 


Quality  manager  responsibilities:  quality  support,  quality 
tracking,  quality  analysis,  and  reporting 


Support  manager  responsibilities:  tool  support,  configuration 
management,  change  control,  reuse,  and  reporting 


A  “line”  role  manager 


A  “line”  role  manager 


A  “line”  role  manager 


A  “line”  role  manager 


A  “staff’  role  manager 


A  “staff’  role  manager 


A  “staff’  role  manager 


A  “staff’  role  manager 


Meeting  role  descriptions:  chairperson,  recorder, 
facilitator/timekeeper,  attendees 


TSP  inspection  process  roles  and  responsibilities:  moderator, 
producer,  recorder,  timekeeper,  reviewers 


TSP  team  leader  responsibilities:  leadership,  people 
management,  team  coaching,  quality  management,  project 
management,  team  responsibilities 


TSP  team  member  roles  and  responsibilities:  personal 
discipline,  personal  management,  and  team  responsibilities 
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5.4  Other 


Grouping  /  Name 


Preparation  checklists 


PREPL 


PREPR 


Launch  guidance 


Launch  coach 


Marketing 


Other  attendees  (2) 


Senior  Management 


Team  leader  (2) 


Preparation  for  launch 


Preparation  for  relaunch 


Launch  guidelines  for  the  TSP  coach 


Launch  guidelines  for  marketing  management  presentation 


Launch  guidelines  for  TSP  coach 


Launch  guidelines  for  senior  management  presentation 


Launch  guidelines  for  team  leader 


Team  members  (2) 


Other  pre-launch 
assets 


Initial  contact  letter 


Preparation  package 
cover  letter 


Preparation  package 
instructions 


Default  guidelines 


Planning  guidelines 


Quality  guidelines 


Executive  assets 


Plan  assessment  checklist 


Quarterly  review 
checklist 


TSP  introduction 
strategy 


Other  specifications  and 
assets 


NOTEBOOK 


STATUS 


SUMMARY 


TSP  workbook 
(individual  and 
consolidated) 


Checkpoint  Review 


Weekly  Meeting 
Minutes 


Launch  guidelines  for  team  members 


TSP  launch  preparation 


TSP  launch  preparation  material 


TSP  launch  preparation  material 


SEI-provided  benchmark  planning  metrics 


SEI-provided  benchmark  quality  metrics 


Team  plan  review  questions;  a  quick  start  for  an  executive 
reviewing  a  TSP  team’s  plan 


Project  review  questions;  a  quick  start  for  senior  managers  to 
probe  the  status  of  a  TSP  project 


A  generic  procedure  and  timeline  for  TSP  implementation  in 
an  organization 


These  assets  can  be  found 
in  Winning  with  Software 
[Humphrey  02]. 


Storage  for  project  artifacts 


Management  status  report 


Project  analysis  report 


Automated  individual  and  team  (consolidated)  plans  and 
actuals  for  size,  effort,  defects,  and  schedule;  functionally 
equivalent  versions  of  asterisked  (*)  items  above  under 
Forms  are  included  in  the  TSP  Workbook 


A  review  of  the  project  to  date  conducted  by  the  TSP  coach 
or  other  process  expert 


Minutes  from  weekly  team  meetings 


Excel-based;  provided  by 
the  SEI  as  part  of  the 
licensed  TSP  product  suite 
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6  Observations  by  Process  Categories  and 
PAs 


6.1  TSP  and  CMMI  Project  Management  PAs 

The  Project  Management  process  areas  cover  the  project  management  activities  related  to 
planning,  monitoring,  and  controlling  the  project.  The  page  numbers  for  each  process  area  as 
listed  below  are  from  CMMI:  Guidelines  for  Process  Improvement  and  Product  Improvement 
[Chrissis  03]. 


The  Project  Management  category  contains  the  following  process  areas. 


Project  Planning 

pages  405-428 

Project  Monitoring  and  Control 

pages  391-404 

Integrated  Project  Management  for  DPPD 

pages  187-216 

Risk  Management 

pages  497-516 

Integrated  Teaming 

pages  231-246 

Quantitative  Project  Management 

pages  441-464 
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6.1 .3  Integrated  Project  Management  (IPM) 
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6.1 .4  Integrated  Project  Management  (IPM  SG3,  SG4)  -  IPPD 
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6.1 .5  Risk  Management  (RSKM) 

The  Risk  Management  (RSKM)  process  area  takes  a  more  continuing,  forward-looking  approach  to  managing  risks  with  activities  that  include 


likelihood  or  likely  effect  on  the  project’s  plans. 
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member,  role 


6.1 .7  Quantitative  Project  Management  (QPM) 
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SG2.  The  performance  of  selected 
subprocesses  within  the  project’s  defined 
process  is  statistically  managed. 
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7  TSP  and  CMMI  Process  Management  Process  Areas 


</) 

C/> 

LU 

O 

o 

cc 

0. 

H— 

o 

fl> 

a 

o 

o 

co 


■ 


bO 
.3 
%— » 

c 


I 

E 

o 


O  4) 

tS 


bfi 

3 

o 

"a 

<o 

TJ 

b£ 

3 

1 

o 

P 


£ 

£ 

13 

X 

<D 


a 

a3 

2 

03 


CD 

O 

O 


g>  & 

1  ■§ 

3  C3 

BJ  4) 

"S,  b 

.  .o 


bO 

3 

‘2 

«G 

<u 

T3 

O 

■*-» 

T3 

<L> 


O 

1 

3 

C 

V 

bo 

B) 

a, 


a  j=  zj 

H 


m 

o 


W 

.22  c/3  c/3 

•ti  S  -S 


o 

St 


3 

O 

u 

1 

c/3 

C/3 

u 

u 

o 


C/3 

0) 

o 

2 

a 

bO 

C 

2 

.1* 

T3 

C 

3 


£ 

U 


e 

5 

<33 

£ 


tj 

bO  -§ 
C  p 


■e 

3 

c/3 

St 

I 


K 

a 


&  & 

3  * 

I  $ 

<L>  s 
bO  == 
3  O 

s  *■* 

£  c 
S  ° 

^  o 

c/3 

ft  W> 

o  5 

>  2 

Oh  .t 5 


§ 

~  5 
>• 
2 
B. 


<D 

X 

H 


co 

CJ 

2 

Q. 

•S 

s 


LO 

CD 


CMU/SEI-2004-TR-01 4 


V\S  I 

*.  ^3 
C  g  ro 
O  .£3  p 
■d  g  a 

&  S>-2 

&  °  g 
-  p  o 

§  £  g 

E  2  J2 


£  Vh 

“  8  a- 

P  Q,  <D 

8  £5 

Vh  *,“H  h  . 

a  s  O 
T3  ^  ~ 
c  •«  « 


ra  c3 

.£3  U 
c 


-rt  C  C  5,1 


| 

s 

■s 

C 

1 

w 

*c3 

C fi 

or) 

O 

.2 

& 

’*3 

8 

*> 

T)  §  C 
c  a  a  g 
«  g  E  .2 

S  i  |  1 

P-  O  cO 
O  O  &  > 
«  fe  C  <u 
c  **  •**  *-> 

O  “2  02  P 

._  02  3 

■a  S  o  t) 

N  .2  go 
*S  fc  O* 

1 1  S'* 
°  !■§  ! 
£  s  1  *3 

o  •-  2 

S.-S  8  2 

ro^& 

_,  02  pH  « 

S  «  .  02 

2  «  02  02 

«  8  §  8 

a  .S  1  e 

«  S  E  a 

P  S  2  «K 


2  £  3  o 

*  ■$  |  5 

S  «  3 

O  J£  «  H 

-  f  f  *g 

3  I  !  S 
[2  “  ~  8 
«  P  13  02 
S  2  ,E  8 

y  E  «  o 

5  3  £  d- 

•3  .2  p  .g 

2  ^  b  ti 

c  ?.  _.  TO 

.2  O  U3 

*4-*  h.!\  ^  .2 

a  SP  »  *3 

N  .£  g  C 

•a  g  p 
«  P  p  E 
£P  2  fe,  J2 
O  2  «  & 
o  >S  "c  .5 
H  §  -a  .S 


&  |  o 

i  u  ?■ 


00  &£> 
U  ^  « 

Q.  TO  O 

p  £  8 


g  go  g) 

H  o  « 


•§  -s 

T3  <£* 


C 

S3  '§ 

S  i 

5  =1 
bfi  to 

£  ’o 

*c  « 

3  CL 
X  on 
U  u 


K  tf  w  O  .S 


^  •« 


O) 

«  s 

£  B 

£  S 

3  §  -g 

s  »  -S 

i  i  s 

t:  %  b 

1  2  8 

ft  a  a 

°  02  g 

«  B  " 

u  o  f 

B  S  « 

u  tB  {j 

£  N  .25 

2  !  ’g 

ft  Ml  t 

1  fe  g 


arations  make  the  baseline  TSP 


CMU/SEI-2004-TR-014 


CD 


cd 

-C 


T3 

.§ 

3 

cr 

S 


"O  nu 

0)  c/) 

C 

bX)  X3 

1  S2 

'2  £ 
**  CO 

*3  v* 

5  jg 

o  E 

«J  4) 

«  E 

6  E 

a  I 


Cd 

x: 


C/3 

«  ig 


§  * 
•*3  o> 
2  O 
*S  TJ 

cd  (D 
OX)  c 

J-H 


3 

o 

o 

T3 

E 

s> 

o 

L* 

ca 

■*-» 

c  ^ 

a  £ 
E  2 
a,  & 

°  S 

>  & 

4)  CUD 

"?  E 

60  *B 

.S  ’§ 

.s  ** 

'ta  « 

£  js 

T3  4-i 
<0  O 

SP  « 

ca  w 

U 

c 
a) 
> 


I 


<u 

•a 


o 

<u 

J3 


(6 

-a 

<D 

<D 

e 


ea 

«-» 

Xl 

o 

o 

T3 

<D 

a, 

o 


o 

■a 

3  !t3 
o  ® 
c  u 

60  t* 
3  W) 
3 

■c 


c 

'3 


<u 

g>  o 

.S  T3 
•S  .*3 


<n 


60 

C 


§  . 

c  «, 

g.  E 

i w 


g>  g 

'S 

H 


3 

X3  O 


,5  c 


<a 

E 

jh 

H 


O) 

c 

■  M* 

c 

'S 

£ 

(0 

c 

o 

IIM 

4-> 

03 

N 

IM 

c 

CO 

O) 


CO 

■ 

T- 

IS- 


<L>  3 

13  Cl- 


I 

cd 

4> 


co 

CO 

<D 

a 

O 


cx 

3 

& 

t; 

o 

a. 

a. 

3 


60  T3 

•S  s 
s  w 
'8  •§ 

£ 

”8  2 
C  Oh 

.2  1/5 

3  c/3 

3  O 

.2  b 

C  ca 

Cd  _ 

fi?  o 

O  E 

E 
o 
o 


D  -rt 

00  In 
O  *> 

8  I 

"2  « 
cd  cd 
T3  *C 
G  Q, 
cd  Q 

CO 

tu  ©i* 

°  S* 

O  -C 

co 


8 

3 

cd 

S3 


J= 

H 


sT 

•« 

« 


#<L> 

1 

I 

ill 

Cj 

0>. 


o 

& 

9 


co 

x 


X) 

CO 

a 

CO 

V 

I 


§  o 

<u 

S  to 
N  bo 

g  fi 

g1  a* 

I  I 

Cj—  .  >•* 

O  X) 


«  £ 

.5  ? 

CO  C0 
CUj  ” 

co  O 


3 

X 


5S 


G  ^ 

2  3 


OX) 

o 

to 

£ 

cn 


o 

a 

§ 


G 

u 

00 

E 

G 

a. 

'£ 

co 

*a 

H 

is 

M 

CO 

i 

CJ 

E 

V—* 

a 

T3 

CD 

CD 

G 

X  .3 

£  * 
^  OX) 

o  c 

x  ^3 


—  -q  .3 

r-<  TS 


C 

(l) 

OX) 

o 

c 


Sd 

<D 

to 


§ 


i 

£? 

o 

<D 

X 


<D 

3 


a. 

G 

O 

C 


•-1  0m 

.5  12 

■|  c 


ft. 

w 

ft. 


c 

u 

£ 

D. 

E 

i 


S  .a 

s  ^ 

1  s 


5  a 

4-  *rs 


G  O 

CJ  4> 

X  X 

OX)  o 

c  •*-* 
c  o 
^  ’5b 
■£  S 

I  fi 


X 

a 

§ 

73 


O 

G 


<D 

X 


fl> 

> 

a> 

? 

O 

X 


-S 

o 

•5 

0X) 

G 

‘■3 

<u 

T3 


OX) 

C 


-o 

CD 


o 

c 


*3 

G 

W  -O 

c 

g  C0 

s  ^ 

g  4> 
OX)  X 

«  .IS 


X) 

CO 


O 
O 

7) 


c 

CO 

£ 


*s  i 

CQ  CO 

&  *s 

£  1 


E 

cO 

E- 


<u 

■S 

a> 


<D 

£ 

£ 


o 

G 

C/3 

o 

O 

-a 

c 

.2 

% 

Cl 

S 

a 

G 

E 

s? 


OX)  0D 
£  2 
’£ 

3 


oo 

.£ 

<& 

I 


73 

o 

o 

g 

o 

I 


X 

G 


D 

.£ 

G 

o 


'ob 

C0 


G 

*5 

G 

•a 

£ 

-o 

§ 


c 

o 


E? 

o 


*o 

<u 

4> 

G 


u 

a 

a 

a 

a 


0> 

■S 

4i 


C 

CD 

CO 


c 

o 


O  E 


•*-*  OX) 
c/3  zr 

“  I 

—  -a 


g 

C/3 

T3 

o 

a> 

c 

00 

G 


X 

o 

X 

l  u. 
*9  o 

(D 

‘p* 


G 

O 


1  § 

h 

•“  j- 

x  o 

.2  fi 

x  « 
>  «— 
«  © 
G  >> 


C 

o 

a 


a 

73 

3 

g 

*> 

-5 

G 


a 

s 

00 

t: 

a 

a 

G 


CM 


CMU/SEI-2004-TR-01 4 


f  copyrighted  PSP  and  TSP  training 


7.1.4  Organizational  Process  Performance  (OPP) 

The  Organizational  Process  Performance  (OPP)  process  area  derives  quantitative  objectives  for  quality  and  process  performance  from  the  organiza- 
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GP  2.9.  Objectively  evaluate  adherence  of  Other:  TSP  All:  Once  a  few  pilot  projects  are  underway  and  running  reasonably  well,  the  TSP  coach  (especially 

the  process  against  its  process  description,  introduction  an  external  coach)  often  plays  more  a  quality  assurance  role  to  the  organization’s  process 
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Roles:  Customer  constraints.  Scripts  REQ  and  ANA  specify 
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2.4.  Evaluate  whether  the  product  Scripts :  HLD  The  support  manager  is  the  project  team’s  reuse  P  The  design  manager  responsibilities  are 
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8.1 .4  Product  Integration  (PI) 

The  Product  Integration  (PI)  process  area  describes  generating  the  best  possible  integration  sequence,  managing  product  component  interfaces. 
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determine  the  effectiveness  of  the  inspection 


SG3.  Selected  work  products  are  verified 
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8.1.6  Validation  (VAL) 

The  Validation  (VAL)  process  area  incrementally  validates  products  against  the  customer  needs.  Validation  may  be  performed  in  the  operational 
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1.2-2.  Establish  and  maintain  the  Scripts:  LAU3,  The  support  manager  has  the  responsibility  to  P  No  specific  activities  are  called  for  in  any  of 
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SG2.  The  product  or  product 
components  are  validated  to  ensure  that 
they  are  suitable  for  use  in  their  intended 
operating  environment. _ 


8.2  TSP  and  Engineering  Category  Generic  Practices 

Of  all  the  generic  practice  groupings,  none  is  more  coherent  than  those  of  the  engineering  PAs.  From  the  view  of  these  practices,  there  is  relatively 
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Generic  Practice _ Reference _ Process  Areas  \  Observation _ Ratio 

Roles:  Support  configuration  management  system.  The  “line”  roles  (customer  interface,  design,  implementation,  test) 
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GP  3. 1 .  Establish  and  maintain  the  Scripts:  All  All:  DEV  and  MAINT  describe  full  life  cycles  for  new  development  or  maintenance  projects  S/D 
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leader,  process  specify  is  any  kind  of  specific  standard  way  in  which  to  evaluate  and  act  upon  PIPs  and  other  PM 
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ta  is  reviewed  by  the  team  during  the 


ecific  Practice _ Reference _ Observation _ Rating  Notes 

Roles:  Team  workbooks  or  elsewhere  (e.g.,  form  INS  for 


Roles:  Team  basis  to  exporting  summary  data  to  a 

leader,  team  corporate  database, 

member,  all  role 


Observation 


9.1.4  Decision  Analysis  and  Resolution  (DAR) 

The  Decision  Analysis  and  Resolution  (DAR)  process  area  supports  all  process  areas  by  providing  a  formal  evaluation  process  that  ensures  that 


contained  instance  of  DAR  is  the  LAU7 
script  for  risk  evaluation.  LAU7  takes  the 
explicit  decision  that  risks  are  subject  to 
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9.1 .5  Organizational  Environment  for  Integration  -  IPPD  (OEI) 

The  Organization  Environment  for  Integration  (OEI)  process  area  establishes  the  approach  and  environment  for  the  implementation  of  IPPD.  The 
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9.1.6  Causal  Analysis  and  Resolution  (CAR) 
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9.2  TSP  and  Support  Category  Generic  Practices 

If  there  are  consistent  patterns  in  how  TSP  relates  to  generic  practices  across  the  PAs  of  the  other  process  categories,  there  seems  to  be  no  such 
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GP  2.3.  Provide  resources  for  performing  Scripts:  LAU6  All:  The  team  leader  and  initial  team  member  assignments  are  made  as  part  of  launch  preparation, 

the  process,  developing  the  work  products.  Forms :  SUMS,  Resources  are  assigned  to  project  tasks  during  Meeting  6  of  the  launch.  The  team  leader  and  role 

and  providing  the  services  of  the  process.  TASK _  managers  help  ensure  that  the  tasks  are  properly  staffed. _ 
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10  Summary 


The  results  documented  in  this  report  show  clearly  that  TSP  can  instantiate  a  majority  of  the 
project-oriented  specific  practices  of  CMMI.  In  addition,  many  of  the  organization-oriented 
specific  and  generic  practices  of  the  model  are  supported  at  various  levels  by  TSP  practices. 
One  must  remember,  however,  that  this  is  an  idealized  case,  a  paper  exercise  intended  to 
guide  the  efforts  of  a  process  group  when  implementing  TSP  within  the  larger  context  of 
CMMI-based  process  improvement. 

For  this  analysis  to  be  useful  in  practical  terms,  the  implementing  group  must  take  into  ac¬ 
count  the  realities  of  their  unique  situation,  including  the  size  and  duration  of  typical  projects, 
what  and  how  to  adapt  to  project  sizes  and  durations  at  the  limits  of  the  usual  variation,  and 
what  and  how  to  adapt  to  the  processes  implemented  outside  the  scope  of  single  projects.  TSP 
has  seen  significant  successes  at  dramatically  improving  the  results  of  individual  projects,  but 
the  business  of  CMMI  is  improving  the  results  of  all  projects  in  an  organization.  Working 
together,  these  two  technologies  hold  the  promise  of  rapid,  measurable,  and  sustainable  proc¬ 
ess  improvement  beyond  the  immediate  reach  of  one  or  the  other. 
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Appendix  A:  Supplier  Management 

Process  Areas 


While  the  TSP  does  not  directly  address  the  Supplier  Management  activities,  with  a  little 
thought,  the  practices  from  its  two  process  areas  can  be  planned,  monitored,  and  analyzed 
using  the  TSP  practices  and  principles.  In  general,  the  “Observation”  column  in  the  tables 
below  indicates  likely  behavior  by  an  experienced  TSP  team  in  dealing  with  potential  and 
actual  suppliers  and  the  products  and  product  components  acquired  from  such  suppliers. 

Figure  10  shows  the  percentage  of  Supplier  Management  specific  practices  addressed  by  TSP 
for  each  PA.  For  detailed  observations  of  each  PA,  see  below. 
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Figure  10:  TSP  Practices  Profile  for  Supplier  Management  Process  Areas 
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leader  and  design  manager,  at  a  minimum,  would 


2.2  Perform  activities  with  the  supplier  as  Scripts:  WEEK,  The  supplier  agreement  activities  would  be 

specified  in  the  supplier  agreement.  STATUS _  reflected  in  one  or  more  TASK  plans  and 

Forms:  TASK,  reflected  in  the  corresponding  TSP  workbooks. 

_ TSP  workbooks  Significant  activities  would  be  reported  by  one 
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Integrated  Supplier  Management  (ISM) 
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Roles:  Process  that  it  is  documented  properly  and  used  to  create  to  define  an  evaluation  process, 

and  design  individual  tasks  (TASK).  The  tasks  would  be 

manager  tracked  in  the  TSP  workbooks. 
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Appendix  B:  Process  Management 

Process  Areas  Using  TSP  as 
the  Implementation  Method 


One  of  the  assumptions  for  the  main  body  of  these  observations  was  that  all  projects  in  the 
organization  are  using  the  TSP  for  all  phases  of  a  “normal”  development  life  cycle  (i.e.,  re¬ 
quirements,  architecture,  implementation,  deployment,  and  maintenance).  Several  organiza¬ 
tions  have  started  to  use  the  TSP  for  non-targeted  applications,  such  as  planning  and  execut¬ 
ing  their  organizational  process  improvement  activities  and  their  organizational  training.  This 
appendix  provides  observations  for  the  Process  Management  PAs  when  TSP  practices  and 
principles  are  adapted  to  plan  and  execute  the  associated  specific  practices  plus  the  generic 
practices  across  the  category.  The  analysis  does  not  include  generic  practices  in  the  other 
categories,  although  those  could  easily  be  included  in  the  scope  of  a  process  group’s  work 
plans. 

Figure  11  shows  the  percentage  of  process  management  specific  practices  addressed  by  TSP 
for  each  PA  when  the  TSP  is  used  to  plan  and  execute  the  practices.  Detailed  observations  of 
each  PA  follow. 
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Figure  11:  TSP  Practices  Profile  for  Process  Management  PAs  When  TSP  Is  Used 
as  the  Implementation  Method 
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TSP  workbook  (TASK,  LOGT,  LOGD,  SUMS). 
Custom  scripts  may  be  developed  for  repeated 
tasks. _ _ _ _ 
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LOGT,  LOGD  capture  the  execution  data  for  these  tasks 
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Organizational  Training  (OT) 

The  Organizational  Training  process  area  identifies  the  strategic  training  needs  of  the  organization,  as  well  as  the  tactical  training  needs  that  are  com- 
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raining  Forms:  OT  PAT  Plans  and  tasks  to  develop  and  maintain  the  D  Obviously  the  training  needs  of  the 
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tecific  Practice _ Reference _ Observation - _ 

.  Establish  and  maintain  records  of  Scripts:  LAU,  The  OT  PAT  plans  for  these  activities  during  its 
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Organizational  Process  Performance  (OPP) 

The  Organizational  Process  Performance  process  area  derives  quantitative  objectives  for  quality  and  process  performance  from  the  organization’s 
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Specific  Practice _ Reference _ Observation _ Rating  Notes 

1.4.  Establish  and  maintain  the  Scripts:  LAU  Organizational  baselines,  if  they  do  not  already  D 
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these  activities  are  captured  in  the  TSP 
workbook  (TASK,  SUMS,  LOGT,  and  LOGD). 
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